Towards a Contactless Stress Classification Using Thermal Imaging

Thermal cameras capture the infrared radiation emitted from a body in a contactless manner and can provide an indirect estimation of the autonomic nervous system (ANS) dynamics through the regulation of the skin temperature. This study investigates the contribution given by thermal imaging for an effective automatic stress detection with the perspective of a contactless stress recognition system. To this aim, we recorded both ANS correlates (cardiac, electrodermal, and respiratory activity) and thermal images from 25 volunteers under acute stress induced by the Stroop test. We conducted a statistical analysis on the features extracted from each signal, and we implemented subject-independent classifications based on the support vector machine model with an embedded recursive feature elimination algorithm. Particularly, we trained three classifiers using different feature sets: the full set of features, only those derived from the peripheral autonomic correlates, and only those derived from the thermal images. Classification accuracy and feature selection results confirmed the relevant contribution provided by the thermal features in the acute stress detection task. Indeed, a combination of ANS correlates and thermal features achieved 97.37% of accuracy. Moreover, using only thermal features we could still successfully detect stress with an accuracy of 86.84% in a contact-free manne

Assessing the quality of heart rate variability estimated from wrist and finger PPG: A novel approach based on cross-mapping method

The non-invasiveness of photoplethysmographic (PPG) acquisition systems, together with their cost-effectiveness and easiness of connection with IoT technologies, is opening up to the possibility of their widespread use. For this reason, the study of the reliability of PPG and pulse rate variability (PRV) signal quality has become of great scientific, technological, and commercial interest. In this field, sensor location has been demonstrated to play a crucial role. The goal of this study was to investigate PPG and PRV signal quality acquired from two body locations: finger and wrist. We simultaneously acquired the PPG and electrocardiographic (ECG) signals from sixteen healthy subjects (aged 28.5 ± 3.5, seven females) who followed an experimental protocol of affective stimulation through visual stimuli. Statistical tests demonstrated that PPG signals acquired from the wrist and the finger presented different signal quality indexes (kurtosis and Shannon entropy), with higher values for the wrist-PPG. Then we propose to apply the cross-mapping (CM) approach as a new method to quantify the PRV signal quality. We found that the performance achieved using the two sites was significantly different in all the experimental sessions (p < 0.01), and the PRV dynamics acquired from the finger were the most similar to heart rate variability (HRV) dynamics

Parasympathetic-sympathetic causal interactions assessed by time-varying multivariate autoregressive modeling of electrodermal activity and heart-rate-variability

Objective: Most of the bodily functions are regulated by multiple interactions between the parasympathetic (PNS) and sympathetic (SNS) nervous system. In this study, we propose a novel framework to quantify the causal flow of information between PNS and SNS through the analysis of heart rate variability (HRV) and electrodermal activity (EDA) signals. Methods: Our method is based on a time-varying (TV) multivariate autoregressive model of EDA and HRV time-series and incorporates physiologically inspired assumptions by estimating the Directed Coherence in a specific frequency range. The statistical significance of the observed interactions is assessed by a bootstrap procedure purposely developed to infer causalities in the presence of both TV model coefficients and TV model residuals (i.e., heteroskedasticity). We tested our method on two different experiments designed to trigger a sympathetic response, i.e., a hand-grip task (HG) and a mental-computation task (MC). Results: Our results show a parasympathetic driven interaction in the resting state, which is consistent across different studies. The onset of the stressful stimulation triggers a cascade of events characterized by the presence or absence of the PNS-SNS interaction and changes in the directionality. Despite similarities between the results related to the two tasks, we reveal differences in the dynamics of the PNS-SNS interaction, which might reflect different regulatory mechanisms associated with different stressors. Conclusion: We estimate causal coupling between PNS and SNS through MVAR modeling of EDA and HRV time-series. Significance: Our results suggest promising future applicability to investigate more complex contexts such as affective and pathological scenarios

Valence, Arousal, and Gender Effect on Olfactory Cortical Network Connectivity: a study using Dynamic Causal Modeling for EEG

The cortical network including the piriform (PC), orbitofrontal (OFC), and entorhinal (EC) cortices allows the complex processing of behavioral, cognitive, and context-related odor information and represents an access gate to the subcortical limbic regions. Among the several factors that influence odor processing, their hedonic content and gender differences play a relevant role. Here, we investigated how these factors influence EEG effective connectivity among the mentioned brain regions during emotional olfactory stimuli. To this aim, we acquired EEG data from twenty-one healthy volunteers, during a passive odor task of odorants with different valence. We used Dynamic Causal Modeling (DCM) for EEG and Parametric Empirical Bayes (PEB) to investigate the modulatory effects of odors’ valence on the connectivity strengths of the PC-EC-OFC network. Moreover, we controlled for the influence of arousal and gender on such modulatory effects. Our results highlighted the relevant role of the forward and backward PC-EC connections in odor’s brain processing. On the one hand, the EC-to-PC connection was inhibited by both pleasant and unpleasant odors, but not by the neutral one. On the other hand, the PC-to-EC forward connection was found to be modulated (posterior probability (Pp)>0.95) by the arousal level associated with an unpleasant odor. Finally, the whole network dynamics showed several significant gender-related differences (Pp>0.95) suggesting a better ability in odor discrimination for the female gender

Cortical network and connectivity underlying hedonic olfactory perception

Objective. The emotional response to olfactory stimuli implies the activation of a complex cascade of events triggered by structures lying in the limbic system. However, little is known about how this activation is projected up to cerebral cortex and how different cortical areas dynamically interact each other. Approach. In this study, we acquired EEG from human participants performing a passive odor-perception task with odorants conveying positive, neutral and negative valence. A novel methodological pipeline integrating global field power (GFP), independent component analysis (ICA), dipole source localization was applied to estimate effective connectivity in the challenging scenario of single-trial low-synchronized stimulation. Main results. We identified the brain network and the neural paths, elicited at different frequency bands, i.e. θ (4-7Hz), α (8-12Hz) and β (13-30Hz), involved in odor valence processing. This brain network includes the orbitofrontal cortex (OFC), the cingulate gyrus (CgG), the superior temporal gyrus (STG), the posterior cingulate cortex/precuneus (PCC/PCu) and the parahippocampal gyrus (PHG). It was analyzed using a time-varying multivariate autoregressive model to resolve time-frequency causal interactions. Specifically, the OFC acts as the main node for odor perception and evaluation of pleasant and unpleasant stimuli, whereas no specific path was observed for a neutral stimulus. Significance. The results introduce new evidences on the role of the OFC during hedonic perception and underpin its specificity during the odor valence assessment. Our findings suggest that, after the odor onset different, bidirectional interactions occur between the OFC and other brain regions associated with emotion recognition/categorization and memory according to the stimulus valence. This outcome unveils how the hedonic olfactory network dynamically changes based on odor valence